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(54) HAIR COLOR ADVICE SYSTEM 

(57) An object of the present invention is to build a 
simulated image in which a subjects hair is changed to 
a desired color, and to accurately suggest the hair dye 
needed to dye the subject's hair from its existing color 
to the desired color. To achieve this object, the hair color 
advice system according to the present invention com- 
prises (i) an image memory means into which image da- 
ta regarding the subject is input and stored, (ii) a 
processing means that finds the hair area in the input 
image of the subject and builds a simulated image in 
which the color of the hair area is changed to any color, 
and (iii) a monitor 4 on which the input image of the sub- 
ject and/or the simulated image are displayed. 
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Description 
TECHNICAL FIELD 

[0001 ] The present invention relates to a method and 
system by which color of hair is simulated on the hair 
area of a subject over an image of the subject in order 
to find what color the subject desires, and identify the 
hair dye needed to obtain the color. 

BACKGROUND ART 

[0002] Hair dyes and bleach are used to make gray 
hairs less conspicuous or to dye hair a desired color as 
a dressing up means. Hair dyes include temporary dyes 
(color shampoo, color conditioner, color treatment con- 
ditioner, etc.) that are easy to apply but the dyed hair 
retain the color for a short time, semi-permanent dyes 
(hair manicure, clear-type hair manicure, etc.) that pro- 
vide a dye effect that can be continuously maintained 
through penetration of an acidic dye into the interior of 
the hair, and permanent dyes that achieve an essentially 
permanent dye effect through oxidation polymerization 
of the dye in the interior of the hair, and a particular type 
of hair dye is selected depending on the intended use. 
[0003] Each of these types of dyes is prepared in nu- 
merous color numbers, and each color of dyes is shown 
by means of printing on the box containing the dye, or 
by means of sample tresses of dyed hair. 
[0004] Incidentally, the color of the hair after dyeing is 
not determined solely by the inherent color of the dye, 
but affected by the color of the hair before it is dyed. 
Therefore, even where the same color dye is used, the 
color of the hair after dyeing differs considerably de- 
pending on whether the hair is black, brown or gray be- 
fore dyeing. In addition, where the same color dye is 
used, the hair color after dyeing also differs depending 
on whether the hair is being dyed for the first time using 
the dye, or whether the hair is being dyed again after 
the color from a previous dyeing has faded. 
[0005] Consequently, it is difficult to predict the color 
that will result from dyeing any person's hair solely from 
the printing on the box or the sample tresses, and the 
problem arises that the actual color of the hair after dye- 
ing is different from the color anticipated. 
[0006] Furthermore, hair dyeing not only changes the 
color of the hair, but significantly affects the overall ap- 
pearance of the person whose hair is being dyed. More- 
over, it is even more difficult to predict the person's over- 
all appearance after the hair is dyed than it is to predict 
the color of the person's hair after dyed. As a result, even 
where the hair color itself turns out as expected, the per- 
son may still be displeased with their overall appearance 
after the dyeing is performed. 

DISCLOSURE OF THE INVENTION 

[0007] An object of the present invention is to accu- 



rately suggest the appropriate hair dye to change a per- 
son's hair color to the desired color, and to confirm the 
person's overall appearance afterthe hair was dyed into 
the desired color, 
s [0008] The inventors have discovered that, in order to 
attain this object, it is effective to (1) input the image of 
the subject (a person) into a memory means of a com- 
puter, simulate on a monitor (display screen) the hair 
color on only the hair area of the input image, and show 
io the simulated image to the subject so that the subject 
may confirm his or her overall appearance after dyeing, 
as well as to (2) output the name of the hair dye needed 
to dye the subject's hair into the same color as the hair 
color of the simulated image, based on a database that 
describes references between hair dyes and hair colors 
before and after dyeing therewith. 
[0009] The present invention provides a hair color ad- 
vice system comprising (i) an image memory means into 
which image data regarding the subject is input and 
stored, (ii) a processing means that finds the hair area 
in the input image of the subject and builds a simulated 
image in which the color of the hair area is changed to 
any color, and (iii) a monitor (display screen) on which 
the input image of the subject and/or the simulated im- 
age are displayed. 

[0010] The present invention also provides a hair 
color advice method comprising (i) a step in which the 
image data of the subject is input to the image memory 
means, (ii) a step in which the processing means finds 
the hair area in the input image of the subject and builds 
a simulated image in which the color of the hair area is 
changed to any color, and (iii) a step in which the input 
image of the subject and/or the simulated image are dis- 
played on the monitor (display screen). 
[0011] In the present invention, the hair dye includes 
(i) permanent dyes, (ii) semi-permanent dyes such as 
hair manicures, (iii) temporary dyes such as hair foams, 
shampoos, conditioners, treatment conditioners, etc. 
containing coloring agents, and (iv) bleaches, and the 
hair dyeing includes (i) changing the hair color by means 
of a hair dye and (ii) bleaching the color of the hair by 
means of a bleaching agent. 



BRIEF DESCRIPTION OF THE DRAWINGS 

45 

[0012] 

Fig. 1 is a flow chart of the hair color advice method 

of the present invention; 
so Fig. 2 is a system construction diagram of the hair 

color advice system of the present invention; 

Fig. 3 is a display screen showing the subject image 

input into a personal computer; 

Fig. 4 is a drawing to explain masking; 
55 Fig. 5 is a display screen showing an array of sim- 
ulated images; 

Fig. 6 is a display screen showing a simulated im- 
age of a specified hair color; and 
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Fig. 7 Is a display screen showing a hair dye sug- 
gested. 

BEST MODE FOR CARRYING OUT THE INVENTION 

[0013] Fig. 1 is a flow chart showing one embodiment 
of the hair color advice method pertaining to the present 
invention. Fig. 2 shows an example of the construction 
of the system that provides this hair color advice meth- 
od, and includes a personal computer 1 that serves as 
a memory means into which image data regarding the 
subject is input and stored and as a processing means 
that finds the hair area of the subject in the input image 
and simulates an image with a hair color. Connected to 
the personal computer 1 are, as an image reading 
means, a digital still camera 2 that takes a photograph 
of the subject, an Image scanner 3 that reads image data 
from the photograph of the subject, and a device that 
can read image data over telecommunications network 
such as the Internet. A monitor (display screen) 4 and 
a printers are also connected to the personal computer 
1 , and are used to show the subject's image data stored 
in the personal computer 1 , as well as associated sim- 
ulated image data, as required. 

[0014] In the hair color advice method pertaining to 
the present invention, first, the subjects image data is 
input into the personal computer 1 that serves as an im- 
age memory means. More specifically, a photograph of 
the subject is taken of using the digital still camera 2, 
and this image data is input into and stored in as an im- 
age file in the personal computer 1 . Alternatively, image 
data may be taken from the photograph of the subject 
and input into the personal computer 1 by means of the 
image scanner 3, or subjects image data previously 
stored on a desired storage medium may be input into 
the personal computer 1 . It is also acceptable if a face 
image of the subject is read over telecommunications 
network such as the Internet and this image data is input 
into the personal computer 1 . The method by which the 
image data is input into the personal computer 1 is not 
limited to the methods described above. 
[0015] To enable the personal computer 1 to accu- 
rately find the hair area when building the image simu- 
lating for the hair color, it is preferred that the back- 
ground upon taking a photograph of the subject using 
the digital still camera 2 or the background color in a 
photograph of which the subject is taken, is clearly dis- 
tinguishable from the hair color of the subject. Ordinarily, 
the preferred background color is blue. 
[0016] Next, the input image of the subject is output 
to and shown on the monitor 4. Fig. 3 shows the image 
of the subject shown on the monitor 4. This step allows 
the subject to confirm his or her own input image into 
the personal computer 1 . 

[0017] In the present invention, the personal compu- 
ter 1 is given also as a processing means which has a 
function to distinguish the hair area in the input image 
of the subject. This function renders unnecessary the 



complex operation that the operator of the personal 
computer uses a mouse to cut out the hair area that 
comprises the subject of the simulation. This distin- 
guishing function may be enabled in the personal com- 
5 puter 1 by incorporating therein a software program that 
distinguishes the hair area from the non-hair areas 
based on such parameters as their brightness and hue, 
as well as the continuousness of the changes in such 
parameters or the like. 

10 [0018] Where the hair area in the input image of the 
subject is distinguished by means of the personal com- 
puter 1 , it may occur that, depending on the hair color 
or other factors, the actual hair area is not accurately 
distinguished from the non-hair areas. Therefore, it is 

15 desirable that the areas that are not included in the ac- 
tual hair area but may be identified by the personal com- 
puter 1 as a part of the hair area because they are simi lar 
to the actual hair area In terms of brightness, hue and 
the like, and may be subjected to hair color simulation 

20 together with the hair area, be designated in advance 
so that haircolorsimulation is not carried out for the des- 
ignated areas. Therefore, it is preferred that the person- 
al computer 1 has a masking function by which certain 
areas of the input image of the subject are designated 

25 as non-simulation areas by the operator of the personal 
computer. 

[001 9] Conversely, where as a result of reflection dur- 
ing photo exposure or the like, the input image of the 
subject is whited out in part in the hair area, there is a 

30 risk that the personal computer 1 will distinguish any 
whited-out part of the actual hair area as a non-hair area, 
and will eliminate that part as a subject of the simulation. 
To solve this problem, it is preferred that the hair color 
simulation is performed with respect to a pre-designated 

35 area regardless of the results of the hair area determi- 
nation carried out by the personal computer 1 . There- 
fore, it is preferred that the personal computer 1 has an 
anti-masking function by which an area of the subjects 
input image specified by the operator of the personal 

to computer is deemed a hair color simulation area. 

[0020] As a specific example of this masking step, 
where the subject has black hair, for example, the per- 
sonal computer operator specifies such dark areas as 
the eyes, the nostrils and mouth, clothing or the like, as 

45 indicated by the areas enclosed with dashed lines in Fig. 
4, and Instructs that masking is performed with respect 
to these areas. The personal computer operator may 
specify based on the preference of the subject, whether 
the eyebrows will be simulated together with the hair or 

so not. Where the hair is light brown or blonde, like that of 
a European people, the personal computer operator 
specifies on the display screen and performs masking 
with respect to bright areas such as the face, clothing, 
etc. In this case as well, eyebrows are handled in the 

55 same manner as in the situation in which the hair was 
dark. 

[0021] To enable the personal computer 1 to accu- 
rately distinguish between hair areas and non-hair areas 
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in the subjects input image, it is preferred that the per- 
sonal computer 1 is able to individually set the parame- 
ters required to differentiate between hair and non-hair 
areas in accordance with the image background color, 
the hair color, etc. 

[0022] Afterthemaskingsteporthe anti-masking step 
is performed, the hair color desired by the subject is 
specified on the personal computer, and a hair color sim- 
ulated image is built and displayed on the monitor 4 in 
which the hair area (more precisely, the hair area found 
by the personal computer 1 , or the corrected areas com- 
prising the hair area and the areas designated by means 
of the masking or anti-masking) in the image of the sub- 
ject is changed to the desired hair color. 
[0023] For the method of building the simulated im- 
age, it is preferred that the color of the hair area in the 
input Image is properly reflected in the image input into 
the computer, and that a color having a prescribed hue 
or brightness is overlaid onto it. More specifically, it is 
preferred that a simulation software program having 
these functions is incorporated into the personal com- 
puter 1 . 

[0024] Because the simulated image displayed on the 
monitor 4 represents the initial image of the subject that 
was incorporated into the personal computer 1 , with only 
the hair area changed to the desired color, the subject 
can not only confirm the hair color after dyeing by means 
of this simulated image, but can get a feel for his or her 
overall appearance after dyeing. 

[0025] In the step in which the subject specifies a hair 
color, it is preferred that an array of simulated images in 
which the subject's hair is dyed to various representative 
colors are first displayed on the monitor 4 (see Fig. 5), 
whereupon the subject may generally indicate the de- 
sired hair color from among the simulated images dis- 
played. When this is performed, the subject's prefer- 
ence regarding the permanence of the dye, i.e., the sub- 
ject preference for a temporary dye or a semi-perma- 
nent dye, as well as the subject's prior history of dyeing, 
the existence of any allergic reactions to chemicals of 
the subject, etc., may be input to the personal computer 
1 , if necessary, so that this information is reflected when 
the dye corresponding to the desired hair color is sub- 
sequently output from the personal computer 1 . 
[0026] It is preferred that after the hair color is roughly 
specified, an array of simulated images Is displayed in 
which the hair colors are changed by degrees into colors 
nearby the desired color, so that the subject may once 
again specify the desired hair color. It is furthermore pre- 
ferred that the simulated image of the hair color thus 
specified by the subject is displayed in an enlarged fash- 
ion on the monitor 4 (see Fig. 6). 

[0027] The specifying of the hair color and the display 
of the simulated images may be performed repeatedly 
until the subject is satisfied. 

[0028] After the hair color desired by the subject is 
confirmed, it is preferred that a hair dye suggesting step 
is conducted in which, based on a database in which 



accumulated is information on hair dyes and hair colors 
before and after dyeing therewith, the personal compu- 
ter 1 outputs the dye necessary to dye the subject's hair 
into the color specified by the subject; more specifically 

s the personal computer 1 displays on the monitor 4 the 
type, color number, product name, etc., of the dye nec- 
essary to dye the subject's hair into the color specified 
by the subject, and thereafter output these information 
to the printer 5. The contents of these information may 

10 be transmitted to the subject via telecommunications 
network such as the Internet, or may be sent to the sub- 
ject via direct mail. 

[0029] It is furthermore preferred that the hair color 
simulated image and the actual product image 6 are dis- 
15 played on the hair dye output screen (see Fig. 7). In this 
way, the subjects may know with certainty the hair dye 
needed to achieve the desired hair color for his or her 
own hair. 



[0030] As described above, because the present in- 
vention enables the subjects to know their appearances 
as the simulated images when their hairs are dyed into 
the desired colors, the subjects can confirm not only 
their hair colors after dyeing, but also their entire overall 
impressions. In addition, by means of the present inven- 
tion, the hair dyes needed to dye the subject's present 
colors into the desired colors may be reliably identified 
as well. 
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35 1 . A hair color advice system comprising: 

an image memory means into which image da- 
ta regarding the subject is input and stored; 
a processing means that finds the hair area in 

^o the input image of the subject and builds a sim- 

ulated image in which the color of the hair area 
is changed to any color; and 
a monitor (display screen) on which the input 
image of the subject and/or the simulated im- 

45 age are displayed. 

2. The hair color advice system according to claim 1 , 
wherein said system includes an image reading 
means that reads image data regarding the subject. 

50 

3. The hair color advice system according to claim 1 , 
wherein said processing means has a masking 
function by which designated areas within the input 
image of the subject are deemed hair color non-sim- 

55 uiation areas, or an anti-masking function by which 
designated areas within the input image of the sub- 
ject are deemed hair color simulation areas. 
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4. The hair color advice system according to claim 1 , 
wherein said processing means outputs the dye 
needed to dye the subject's hair to the color of hair 
in the simulated image, based on a database in 
which accumulated is information on hair dyes and 5 
hair colors before and after dyeing therewith. 

5. A hair color advice method comprising: 

a step in which the image data of the subject is 10 
input to the image memory means; 
a step in which the processing means finds the 
hair area in the input image of the subject and 
builds a simulated image in which the color of 
the hair area is changed to any color; and *s 
a step in which the input image of the subject 
and/or the simulated image are displayed on 
the monitor (display screen). 

6. The hair color advice method according to claim 5, 20 



wherein after the input image of the subject is dis- 
played on the monitor, but before the simulated im- 
age is built, the masking step to designate hair color 
non-simulation areas within the input image of the 
subject, or the anti-masking step to designate hair 25 
color simulation areas within the input image of the 
subject, is performed. 

7. The hair color advice method according to claim 5, 
further comprising a hair dye suggesting step in 30 
which the hair dye needed to dye the subjects hair 
to the color of the hair in the simulated image is out- 
put, based on a database in which accumulated is 
information on hair dyes and hair colors before and 
after dyeing therewith. 35 
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